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^ . Abstract 

\o ■ 

ly-^ ' In this article we study the behavior of globally coupled assemblies 

I of a large number of Integrate and Fire oscillators with excitatory 

' pulse-like interactions. On some simple models we show that the ad- 

I ditive effects of pulses on the state of Integrate and Fire oscillators 

are sufhcient for the synchronization of the relaxations of all the os- 
cillators. This synchronization occurs in two forms depending on the 
' system: either the oscillators evolve "en bloc" at the same phase and 

therefore relax together or the oscillators do not remain in phase but 
their relaxations occur always in stable avalanches. We prove that syn- 
' O I chronization can occur independently of the convexity or concavity of 

the oscillators evolution function. Furthermore the presence of disor- 
der, up to some level, is not only compatible with synchronization, but 
removes some possible degeneracy of identical systems and allows new 
mechanisms towards this state. 
^ '• PACS numbers: 05.20.-y-Fb,64.60.Cn,87.10.-Fe 

H ■ LPTHE preprint 9604 

1 Introduction 

The emergence of a large scale rhythmic activity in dynamical systems with 
a high number of degrees of freedom is a widespread phenomenon occurring 
in different fields. In physics, macroscopic synchronization may be found in 
the behavior of laser ^ , charged density waves |^, ^ , networks of Josephson 
junctions @, ^. In Chemistry, oscillating chemical reactions are the result 
of large scale synchronized activity , |0] . Many biological systems display 
also large scale synchronization |Q] . One of the most cited example is given 
by the south-eastern fireflies where a large number of insects gathered on 
trees flash altogether^, 11, 12]. Other examples are reviewed in [|l3[ and 



include cells of the heart pacemaker, circadian neural networks, glycolytic 
oscillations in yeast cells suspension, collective oscillations of pancreatic beta 
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cells, crickets that chirp in unison |14|, [T^. Coherent oscillations are also 
believed to be important in neuronal activity []l6| , 0]. 

The previous systems exhibiting large scale periodic activity are usually 
modeled as a large assembly of coupled oscillators. The periodicity shown 
by the whole system is then the result of the collective synchronization of 
a macroscopic set of the elementary oscillators. Due to the large diffusion 
of collective rhythmic behavior in nature, it is important to search and 
investigate all the possible mechanisms that may lead to this phenomenon 
in populations of oscillators. 

Most of the works related to collective synchronization in the last decade 
studied populations of stable limit cycle oscillators described by ordinary 

© 1, 



differential equations continuously coupled in time llq, 19 
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24| , |2q , |26| , P?] ]. Much theoretical understanding has been obtained for such 
systems, as well on models where the phases are the only relevant dynamical 
parameters ||, |o|, |2l|, ||, |2|, |||, |2|, ||, |9|, Q or on models where 



phase and amplitude can vary[|2^, |3l|, |2^, and for populations of identical or 
almost similar oscillators. Generally, global coupling has been assumed, i.e. 
each oscillator is supposed to interact with all the others. Local interactions 
have also been investigated! 23, 22, [20] showing more complex behaviors. 



These numerous studies do not however account for the important case, 
especially in biology, of episodic pulse-like interaction, where oscillating 
units, cells or neurons, often communicate through the sudden firing of a 
pulse. Biological oscillators exchanging pulses are currently modeled as In- 
tegrate and Fire (IF) oscillators 1 32, 33 1 which are simply described by some 
real valued state variable - representing for example a membrane potential - 
monotonically increasing up to a threshold. When this threshold is reached 
the oscillator relaxes to a basal level by firing a pulse to the other oscillators 
and a new period begins. This is the case for example for fireflies commu- 
nicating through light flashes |9|, |lO|, 34, for crickets exchanging chirps 
14, 15 1, for cardiac cells interacting with voltage pulses |35] and for neurons 



receiving and sending synaptic pulses. 

Large assemblies of oscillators with pulse-like coupling have been stud- 
ied only recently. In their seminal work, Mirollo and Strogatz|36] prove 
rigorously that a population of identical Integrate and Fire oscillators glob- 
ally coupled by exciting pulses added to the state variables can synchro- 
nize completely for a certain kind of oscillators (convex oscillators). As 
showed by Kuramoto|37] who gives a description of such a system in terms 
of a Fokker-Plank equation, the coherent collective synchronization persists 
when random noise is included in the system. Recently Corral et ai.[38] have 
generalized the Mirollo and Strogatz model for arbitrary evolution function 
of the oscillators and arbitrary response function to pulses and established 
some conditions sufficient for synchronization. When transmission delays 
are taken into account, Ernst et al. |]39[| find that with excitatory pulses, 
clusters of synchronized oscillators spontaneously form but are unstable and 
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desynchronize after a time; partial synchronization is however achieved with 
inhibitory pulses in the form of several stable clusters of oscillators in phase. 
Other studies consider models of Integrate and Fire oscillators with the 



pulses smoothed before acting on the oscillator state variable^, |42|] . 



Recently Hansel et ai.^^ showed that rise and fall times can destabilize the 
synchronized state of simple IF oscillators and Abbott and van Vreeswijk 
[41 1 showed that in this case the incoherent asynchronous state can be stable. 
In a model with fall times of the coupling between the oscillators, Tsodyks 
et aJ. ||40|] showed that the complete synchronized state is unstable to inho- 
mogeneity in the oscillators frequencies. Finally Gerstner [43, 17 [ achieved a 
synthesis of results on IF oscillators models by introducing a general model 
containing various versions of IF models as special cases and an analyti- 



cal approach from the point of view of a renewal theory [Q, 45, 46|. In 
the previous studies the oscillators are typically model neurons described as 
leaky integrator on a membrane potential. This assumption determines the 
form of the monotonic variation function of the state variable of the free 
oscillators which in this case must be convex. 

In this article we extend a previous study of IF oscillators with linear 
or concave variation and with a global all to all excitatory pulse coupling 
directly added to the oscillator state variables. According to the theorem of 
Mirollo and Strogatzp^ it was commonly believed that synchronization of 
pulse coupled IF oscillators could be achieved only with convex oscillators. 
We show here that actually synchronization can occur independently of the 
shape of the oscillators which is not therefore a constraint for this behav- 
ior. We present and investigate some general mechanisms that, we think, 
have not been sufficiently recognized previously and that lead to collective 
synchronization in assemblies of linear oscillators without or with quenched 
disorder. These effects, sufficient for synchronization for linear oscillators, 
can also exist for models of leaky integrator oscillators and be combined 
with other mechanisms. 

The aim of this paper is not to study a particular biological or physical 
phenomenon in details but to get a better understanding of the possible 
mechanisms of mutual entrainment that can lead to collective synchroniza- 
tion in models of IF oscillators. Furthermore, systems of simple linear oscil- 
lators of the kind studied in this article are also found in a different context 
than collective synchronization, which is the physics of earthquakes and 
Self-Organized Criticality [48[. This phenomenon is the spontaneous orga- 
nization of a dynamical system with a large number of degrees of freedom 
out of thermodynamical equilibrium, in a critical, i.e. scale invariant, state 
of evolution which is attractor of the dynamics. The building up of the 
long range correlations and power law behaviors characteristic of the criti- 
cal state does therefore not require the fine tuning of a control parameter 
(temperature, magnetic field, etc. . . ) as for the usual critical phenomenon of 
second order phase transitions. Famous examples of dynamical systems with 
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a high number of degrees of freedom beheved to be self-organized critical are 
for example the sandpile model of Bak, Tang and Wiesenfeld |48| together 
with several variants p9|, 50, 51], a model of front propagation |52], evo- 
lution models for species ||53||7 the forest-fire model[Q, etc. . . Self-Organized 
Criticality has also raised interest in Geophysics as a possible phenomenon 
responsible for the scale invariant behavior of earthquakes, whose distribu- 
tion of their number as a function of their magnitude (Gutenberg-Richter 
distribution) is a power law. 

A classical model of earthquakes is the Burridge-Knopoff spring-block 
model, where the fault between two tectonic plates is described as a net- 
work of rigid blocks elastically connected and coupled semi-elastically and 
semi-frictionally to the surfaces of the fault. Due to the relative move- 
ment of the tectonic plates, the stresses on all the blocks increase until the 
stress of some block reaches an upper threshold and relaxes causing the 
slipping of the block and a rearrangement of the constraints on the neigh- 
boring blocs. This can possibly push other blocks to relax and trigger an 
avalanche of slippings, i.e. an earthquake. As first noticed by Christensen 
[55 1, the previous systems can be seen as assemblies of pulse coupled oscil- 
lators: each block is actually an oscillator with the stress upon it acting as 
the state-variable and the pulses being the sudden increment of the strain 
on the neighbors of the slipping bloc. A discretized version of the Burridge- 
Knopoff model by Olami, Feder and Christensen [ 56 1 with linearly varying 
oscillators, nearest neighbors coupling and direct action of the pulses on the 
state variable is believed to be self-organized critical. It has been proposed 



[55, |5^, 47, ^ that the critical behavior of this model is related to the 
tendency to synchronization in such systems. In this article we see that 
the globally coupled models, which are actually mean-field versions of the 
Olami-Feder-Christensen model, are not critical and typically synchronize. 



This paper is organized as follows: In sections |2.1| and 2.2 we show that 
because of a positive feedback of large groups of synchronized oscillators 
on smaller ones, complete synchronization of a set of identical oscillators 
is possible even in cases not taken into account by the theorem of Mirollo 
and Strogatz [36|. In section ^, we show how the introduction of disorder 
on the oscillator properties such as the frequencies, the thresholds or the 
pulse strengths allows a new mechanism that can lead to collective synchro- 
nization. Two effects act together: first, the quenched disorder makes the 
effective rhythms of the oscillators all different. This brings any two oscil- 
lators to relax time to time simultaneously. Second, oscillators that fired 
simultaneously possibly remain locked in a synchronized group. Finally, in 
the last section^, we discuss our results focusing especially on the effects of 
convexity, linearity or concavity of the oscillators state variation function, 
on additivity or not of the pulses, on refractory time after a relaxation and 
on the possible kinds of synchronization. 
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1.1 Models 



In this article we study models of N IF oscillators Oi,i = 1...N repre- 
sented by a real state variable Ei £ [0,Ef],i = 1...N, where the Ef are 
the thresholds of the oscillators. The free evolution of is made of two 
parts: first, a charging, growth, period where the state variable Ei increases 
monotonically in time as long as it is below the threshold Ef according to a 
given free evolution variation function Ei{t) and, second, a relaxation when 
the threshold is reached whereby Ei is reset to zero and a growth period 
starts again. We assume, as it is generally done, that the characteristic time 
for the relaxation is very short compared to the period of the free evolution 
so that the state variable Ei of an oscillator that fires is instantaneously 
reset to zero. 

It is convenient to introduce the phases of the oscillators defined as (pi = 
t mod 4>'[ where is the free period of Oj {Ei{(j)f) = Ef). 

The coupling between biological oscillators, for instance fireflies, has 
been experimentally studied by perturbing the oscillating elements by single 
pulses Knowing that fireflies interact through light flashes and that 

they are believed to be describable by coupled IF oscillators [^, the in- 
teraction between the oscillators is studied by observing the response of the 
periodic flashing of a single firefly to an artificial fiash Following such 
studies several types of couplings have been introduced in biological models 
involving IF oscillators. In the situations under interest, an oscillator is cou- 
pled with others when it relaxes and the coupling takes the form of a pulse 
transmitted to the others. The consequences of the firing on the oscillators 
that have received the pulse depend on the biological situations and on the 
models. 

Pulses may be excitatory, i.e. incrementing the state variables and thus 
anticipating the firing of the receiving oscillators, or inhibitory, i.e. decre- 
menting the states and delaying the firing of the receivers. 

In this article we consider excitatory pulses: 

1. An oscillator receiving a pulse has its state variable incremented by 
the pulse strength. This model of coupling is known as phase advance 
model since the pulses push the oscillators towards their thresholds - 
and possibly above - causing a sudden advance of the phases of the 
oscillators on their period of evolution. 

2. The pulse strength depends on the number of oscillators that fire to- 
gether and obey an additivity principle: the pulse from the simultane- 
ous relaxation of oscillators is an increasing function of the sum of all 
the individual pulses of the firing oscillators. For the sake of simplicity 
we assume in this article direct additivity: the simultaneous firing of n 
oscillators transmits a pulse of strength n5, with 5 the pulse strength 
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of a single oscillator. To account for the global coupling, 6 scales as the 
inverse of the system size: 6 = aEc/N with a a dissipation parameter. 

2 Identical oscillators 

In this section all the oscillators are identical: Ei{t) = E{t), Vi and the 
pulses have the same strength. We first study the case of linear E{t) which 
corresponds to the limit of zero convexity of the model of MiroUo and Stro- 
gatz pf 



2.1 Linear oscillators 

Between two firings, the state variable increases linearly. Without loss of 
generality we take simply Ei{t) = t mod Ec so that < Ei < Ec = 1. Most 
studies do not consider a linear variation of the state. Indeed the oscilla- 
tors are commonly leaky integrators whose evolution between two firings is 
described by the differential equation: 

^^ = So-7E, , 0<E,<E, = 1, (1) 

where So is a constant input current and 7 describes the dissipation. The 
solution of this differential equation is a convex function with the convexity 
controlled by the dissipation 7. 

Mirollo and Strogatz|36] have rigorously proved that with 7 > and 



with constant pulses a population of oscillators always synchronizes. From 
their theorem the convexity seemed to be a necessary condition for syn- 



chronization. However, as first noticed by Christensen [55|, a large set of 
oscillators with linear evolution may effectively synchronize completely. 

As we shall see, the convexity is a sufficient but not necessary condition 
for synchronization. Convexity implies that the increment of the phase of an 
oscillator due to a pulse increases as the oscillator is nearer to the threshold, 
which has the consequence that two oscillators effectively attract each other 
in the course of time. 

We show in the following that simply due to the hypothesis of additivity 
of pulses there is a positive feedback effect towards synchronization in the 
system, which is not necessary in the convex case for the validity of the 
theorem of Mirollo and StrogatzQ. We prove that this effect is sufficient for 
synchronization even on sets of linear and concave oscillators. Let us first 
introduce the notions of avalanche and of absorption that will be important 
in the following. 



^In Mirollo and Strogatz speak of positive feedback but this effect plays no role 
in the demonstration of their theorem. This is why the case of linear oscillators seemed 
to be excluded from synchronization by their theorem. 
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Avalanches. An avalanche of successive firings may occur when an os- 
cillator reaches the threshold: depending on the other oscillator states the 
transmitted pulse may bring some other oscillators to exceed the threshold 
and to fire. Possibly the new pulses may themselves cause further relaxations 
and a cascade of firings until no more pulse is sufficient to bring another os- 
cillator above the threshold. In this study, we assume that the firings and 
that their transmission are very fast compared to the free evolution period 
of the oscillators so that during an avalanche the continuous drive of the 
oscillators is not acting. 

Avalanches are also important for the link with the models on lattices 
showing Self-Organized-Criticality, which will be discussed elsewhere [61]. 



Absorption rule and definition of synchronization. As can be seen 
on fig.|^ in the model defined up to now, oscillators can never get in phase. 
A supplementary rule, that exists also in the model of Mirollo and Strogatz, 
and that we call rule of absorption is necessary for that. Since the oscillators 
synchronize through the firings, we can assume, that the oscillators get in 
phase when they fire in a same avalanche. 

We say that they are absorbed in a synchronized group of oscillators 
with identical phase^ Absorption is implemented naturally by assuming 
that the oscillators that relax during an avalanche are insensitive to the fur- 
ther pulses in the avalanche and remain until it ends at zero value. This rule 
corresponds actually to a refractory time of the oscillators immediately after 
their relaxation. Absorption is necessary for oscillators to get in phase and 
possibly to evolve thereafter synchroneously with the same phase. However, 
it is possible to have a different definition of synchronization in models of 
pulse coupled IF oscillators than evolution in phase, that does not require the 
absorption rule. This is synchronization as locking into avalanches. Since 
we assume a separation of time scales between fast firings and slow con- 
tinuous variation of the state variables, locking in avalanches corresponds, 
on the scale of the free oscillator period, also to a real synchronization of 
avalanches in time. Consider in the model without absorption two oscillators 
that fire in the same avalanche as in figjl], due to the second firing their state 
are different by the value 5, the pulse strength of a single oscillator. When 
the most advanced oscillator is back to the threshold (figJH), the difference 
between the values of the state variables is smaller or equal to 6, in the case 
respectively of convex or linear oscillators. In both cases the pulse from 
the next firing is sufficient to push the second oscillator above or exactly 
at the threshold and therefore to make it fire also: the two oscillators are 
again in a same avalanche. We see that if two oscillators come at some time 

^In ^] Mirollo and Strogatz explicitly state the absorption rule but only for a system 
with numerous oscillators. Since their proof of synchronization is inductive with the system 
of two oscillators as anchor it is important to realize that absorption is actually necessary 
for synchronization also for a pair of oscillators. 
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Figure 1: Evolution without absorption. Values of the states of two identical 
oscillators with convex variation, a. The oscillator (1 ) is at the threshold, 
the oscillator (2) is below the threshold at a distance smaller than 5 which 
is the pulse strength of a single firing, b. The oscillator (1 ) has relaxed 
and the emitted pulse has pushed the oscillator (2) above the threshold and 
makes it fire in avalanche, c. Without absorption the firing of oscillator 
(2) has pushed (1) away from the origin: the oscillators remain dephased 
independently of the convexity. 

to avalanche together they will thereafter continue to fire always together 
in the same avalanche also without absorption. It is therefore sensible to 
speak of synchronization also in such of locking of the firings in a 

same avalanche. We shall discuss in the rest of the paper what kind of 
synchronization is possible for the different models. For systems of identi- 
cal oscillators we can see on fig.§ that locking in avalanches is possible for 
convex or linear variation functions but not for concave oscillators. Phase 
synchronization is in some cases equivalent to synchronization as locking in 
avalanches. Suppose that phase synchronization occurs in a model A with 
the absorption rule. If in the version B of the same model, but without ab- 
sorption, oscillators that are in a same avalanche remain locked, then both 
models A and B evolve in the same way, where the same oscillators that are 
synchronized with identical phase in model A are locked in an avalanche in 
model B. Therefore if complete synchronization occurs in models A then 
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Figure 2: a. Synchronization without absorption for identical convex os- 
cillators. 1) Immediately after their avalanche two oscillators Oi and Oj_i 
have a gap between their states E of value 6. r is the gap between the 
phases of Oi and Oi-i, which does not change during the free evolution 
between firings. 2) When the most advanced oscillator is at the threshold 
the gap between their phases has not changed but the gap between their 
state variables has decreased due to the convexity. The second oscillator 
is at a distance of the threshold smaller than S: the oscillators avalanche 
again together, b. Synchronization without absorption for identical linear 
oscillators. Same as for the convex case, but due to the linearity the gap 
between the states values does not change and is exactly equal to S: the 
oscillators still avalanche together, c. Effect of concavity. The gap between 
the oscillators states increases as the pair approaches the threshold. 
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Table 1: a. Beginning of a cycle with the group Gi at the threshold, the 

(k) 

group Gj is at a distance S(^i jy b. Firing of Gi. c. Gj is at the threshold. 
d. Bring of Gj. e. End of the cycle Gi is back at the threshold. 



complete synchronization occurs also in model B without absorption in the 
form of locking of all the oscillators in a stable avalanche. For simplicity 
we choose to include absorption in this section on linear oscillators (here 
without loss of generality) and in the following on concave oscillators ( then 
necessary for synchronization). 
- Proof of synchronization 

(k) (k) 

Let us call configuration the set of ordered distinct values E\ < E2 < 

(k) 

. . . < Emi = 1 of the state variables present in the system just before the 

(k) (k) 

[k + l)-th avalanche. To each E^ corresponds a group Gi of A^^^ oscilla- 
tors at this value and ^i''^ = Let call cycle, the time necessary for 
all the mfc groups to avalanche exactly once. To trace the evolution of the 
system, it is useful to follow, cycle after cycle, the gaps s^-^'' = E^^^ — Ej^^ 

(k) 

between the values of two groups. If one of these gaps s\ ^ becomes smaller 

than the value N^'^^d of the pulse of the (i)-th group, then the (j)-th group 
gets absorbed by the (j)-th group. On table |l| we find the main steps of 

(k) 

the variation of the gap ■ on a cycle beginning with Gi at the threshold. 
Since the oscillators are identical and linear, both groups have the same 
evolution as long as neither Gi nor Gj relax: they get the same pulses from 
other relaxations with the same phase advances and between pulses their 
state variables increase at the same rate. From table |l| we see that the first 
return map on a cycle for the gap between the oscillators is then: 

sf;'^ = ^ + {N,- N,)6. (2) 

If Ni > Nj the gap between the two groups decreases on each cycle. When 
the difference between the states Ei and Ej becomes less or equal to Ni6, 
then the relaxation of Gi drags Gj along in an avalanche. Due to the ab- 
sorption, both groups then form a greater group with Ni + Nj elements. The 
growth of groups is therefore due to a positive feedback mechanism where 
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the larger groups attract the smaller ones. This effect exists only if there 
are in the population groups of different sizes. We shall now see that as long 
as the number of oscillators is sufficiently large, positive feedback always 
occurs until complete synchronization of the system. If the evolution of the 
system begins with random initial phases for all the oscillators, all the Ei 
are different: there are no groups and one could naively expect no positive 
feedback and no evolution towards synchronization. However some groups 
are naturally formed in the first cycle of the evolution. Indeed if two oscil- 
lators happen to be sufficiently close to each other, i.e. Ei^i — Ei, the pulse 
from the first of them drags the other in an avalanche and a group of two is 
formed. Thereafter there are in the system single oscillators and a group of 
at least size two, so that the positive feedback mechanism can proceed. In 
order to see how probable a uniform random initial configuration leads to 
the feedback effect we must therefore estimate the probability that at least 
two Ei are separated by less than 5 in a set of random numbers between 
zero and Ec- The probability P{s)ds that two random numbers among A'^ 
in [0, Ec] are separated by a distance between s and s + is given in the 
limit ^ 1 by a Poissonian: 



The number of gaps between initial random values satisfying the condition 
for formation of a pair is then: 



Positive feedback and the absorption of oscillators into groups may take 
place as long as there is at least one such a gap. It follows directly from 
(§) that this is typically the case if a/Ec > 1/Af|. For a given level of 
conservation, the number of oscillators needs only to be large enough to 
ensure the onset of positive feedback. 

Initial configurations where no gap is smaller than S = aEc/N are in 
principle possible. However for large systems their occurrence is exponen- 
tially small: each gap has for A^ large a probability e~" of being greater than 
6 = a/N, so that the probability that all the oscillators are too far apart 
for pair formation goes as e~"^. Therefore we may conclude that the set of 
initial configurations that do not lead to absorptions is formed of extremely 
improbable configurations. 

To complete the proof that synchronization is the general behavior of our 
model, we would need to show that the set of initial conditions for which 
the system evolves in a partially synchronized configuration where positive 
feedback stops acting is of almost vanishing measure. As we have seen with 

^In jsHl, Christensen concluded also that synchronization requires a/Ec > 1/A''. 



P{s)ds = —e Ec^ds. 
Ec 



(3) 




(4) 



11 




Figure 3: Binned distributions of the times for synchronization for a popula- 
tion of N = 2000 hnear oscillators with random uniform initial phases, with 
conservation level a = 0.8, 0.5, 0.2, 0.1 and over a sample of 5000 simulations; 
the time unit is the free period. Inset: Mean duration Ts to synchronization 
as a function of a for different population sizes, Ts oc exp —(4.3 it 0.2)a. 



the equation (|2|), this can happen only when all groups are of equal size. 
It is a difficult task to calculate in general the probability for a random 
initial configuration to finally get stuck in such a state. In any case, this is a 
physically ill-defined problem since this probability depends critically of the 
multiples of N: would be prime, then for every initial condition forming 
at least an initial group of two the system would unavoidably synchronize 
completely. 

Numerical simulations show that for increasing the probability for 
incomplete synchronization decreases. For example with a conservation level 
a = 0.2 we found for N = 200, 400, 1000 incomplete synchronization in 
respectively 0.26, 0.2 and 0.05 percent of the cases for 12000 different initial 
configurations. For = 5000 we obtained always complete synchronization. 
When the synchronization was only partial the final state of the system was 
always made of only two groups of equal size A^/2. For N not divisible by 
two we found always complete synchronization. We see that the conditions 
for the existence of positive feedback are almost always fulfilled. 

We studied the time necessary for synchronization numerically. Fig. ^ 
shows the distribution of the durations of the transient Ts until complete 
synchrony for = 2000 and a = 0.1,0.2,0.5,0.8. The mean time for syn- 
chronization increases only slowly with the population size as a power law 
with exponent ~ 0.13 it 0.01. The distributions have a flat tail towards 
long times corresponding to configurations where two groups of almost sim- 
ilar size remain in the system making the positive feedback effect weak and 
slow to achieve the merging of the groups. The inset of fig.Q shows Ts, 
calculated by cutting the tail of the distributions, as a function of a for 
A^ = 200,300,400,500,1000,2000. The duration of the transient Ts de- 
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creases with larger conservation level and for a € [0.2, 0.8] the decrease is 
exponential: Ts oc exp — (4.3 it 0.2)a. Synchronization occurs then quite 
fast in a few free periods. The duration of the transient Tg depends on the 
additivity of pulses. Here we assumed perfect additivity, however if the ef- 
fect of the firing of a group is not simply the sum of all the single firings but 
a smaller function of their number, we expect some longer synchronization 
time. We conclude that for large N synchronization is possible and occurs in 
a finite time even for oscillators with a linear variation which were excluded 
by the theorem of Mirollo and Strogatz |3^] . This theorem and the older re- 
sults of Peskin |35] have been often erroneously interpreted as the necessity 
for synchronization of a "leaky" dynamics of the oscillators, which is related 
to the assumption of a convex variation function E{t). Let us however stress 
that the demonstration in |36] for convex oscillators proves complete syn- 
chronization in this case for any initial configuration apart a set of Lebesgue 
measure null and is also valid without additivity of the pulses. In the case 
of convex oscillators the positive feedback mechanism is not necessary for 
synchronization. Additivity of pulses and the positive feedback mechanism 
that results is a further powerful mechanism which allows synchronization 
under broader conditions than the effect of convexity. 

Our results with linear oscillators prove that leaky oscillators are not 
necessary for the phenomenon of synchronization and that other kinds of 
pulse coupled oscillators can be considered. As we show now, the form 
of the state variation function E(t) is actually not even a constraint for 
synchronization since this phenomenon occurs also for concave E{t). 



2.2 Concave oscillators 

For the sake of simplicity we choose as concave function for the evolution 
in time of the state variable of the oscillators a function of the form E{t) = 
fait) = i", with a > 1. The effect of the concavity on the relative state 
of two oscillators may be seen on fig.|^c. Two oscillators Oi and Oj+i with 
phase difference r see the difference Ei+i{t) — Ei{t) increase as they approach 
the threshold. Therefore with large concavity it is more difficult that a pulse 
of an oscillator triggers an avalanche. However nothing forbids a group of 
oscillators to synchronize if, when the first oscillator reaches the threshold, 
the gaps between them are smaller than the pulse strength. 

Compared with the previous case of a linearly increasing E{t), we see 
that now the effect of positive feedback is opposed by the drawing apart 
effect of the concavity. In a first step we will see that for small concavity the 
positive feedback effect prevails and that synchronization occurs. Although 
one would expect that for larger concavities groups would not be able to 
grow, we will see in a second step that for systems starting their evolution 
with an initial random distribution of the oscillator phases, large concavities 
have the surprising consequence to favor actually the synchronization. 
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Small concavity a ^ 1 We consider first the case of concave functions 
E(t) that are close to the linear case. For clarity we only sketch here the 
main steps of the demonstration and refer to the appendix ^ for details and 
for the complete demonstration. We show there that for a random initial 
configuration of N oscillators groups begin to form and grow by positive 
feedback as in the case of linear oscillators. However when only a few groups 
remain the positive feedback is sufficient to reduce the phase gaps between 
the groups and to cause further synchronization only if the size differences of 
the groups are large enough. The most difficult situation for the occurrence 
of synchronization is when only two groups remain in the system, say Gi 
and G2 with respectively A^i and oscillators (A'^i > N2)- There is then 
a limit value c of the size difference c between Gi and G2 so that complete 
synchronization occurs only if c = A'^i — > c(a, N, a). That is absorption 
occurs only if the size difference between the two groups is sufficiently large 
so that the positive feedback attraction between the groups is strong and can 
overcomes the effect of concavity. Contrary to the case of linear oscillators, 
we see here that two groups of different sizes - not only of equal sizes - 
may remain apart and not synchronize. This is the consequence of the 
drawing apart effect of the states by the concavity (fig.^). Since c(a, N, a) 
is a monotonically increasing function of a, for larger concavities less final 
configurations synchronize completely (for large concavities however another 
effect leading to synchronization can occur, see later). 

For a given there is a finite value a of the concavity so that a < 
a =^ c < 1. That is, for concavities smaller than a the system synchronizes 
completely unless the two last remaining groups are of equal sizes, which 
is the same condition than in the linear case, a goes to one as so the 
corresponding range of concave functions is quite small. We find however 
that synchronization occurs in practice also for much larger concavities with 
high probability. 

The probability V of synchronization corresponds to the probability that 
the gap c between the two last groups is larger than c. Unfortunately it is 
difficult to calculate this probability directly. However we can estimate V 
by assuming simply a uniform distribution of c in [0, A^]. This assumption 
is natural since we start the evolution with a uniform initial distribution of 
the oscillator phases. V is then the ratio of the number of favorable cases, 
N — c, over A'^, the number of possible values of c. Using the value ( |l7|) of c 
calculated in the appendix ^ we get: 

--^((-i)K'-i)n-(i))-((^)T<^' 

Thus, the probability of synchronization is independent of the system size. 
On Table ^ we summarize the results of simulations obtained with 2000 
samples, for a = 0.5 and several levels of concavity. We indicate also the 
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a 1.005 


1.05 


1.1 


i. 99.6 ±0.1 


95.6 ±0.4 


90.6 ±0.6 


ii. 99.4 


94.4 


89.1 



Table 2: i. Probabilities of complete synchronization with the statis- 
tical error obtained with 2000 samples for a = 0.5 for "small" con- 
cavities a = 1.005, 1.05, 1.1. The probabilities obtained with N = 
2000, 1000, 500, 400, 300, 200 are identical within the error, ii. Estimated 
probabilities of complete synchronization with the assumption of uniform 
distribution of the size difference between the two last groups in the system. 




5 10 15 

Time (bins of width 0.5) 



Figure 4: Binned distributions of the duration Ts of the transient until 
complete synchronization in a population of N = 2000 identical concave 
oscillators with concavity a = 1.05 for 2000 samples of uniformly distributed 
random phases. 

probabilities of synchronization expected with the assumption of uniform 
distribution of the size difference of the two last groups. Within the sta- 
tistical error the probabilities of synchronization are independent of and 
correspond to the expectations. 

For small concavities a = 1.005, 1.05, 1.1 we found that the duration Ts 
of the transient until synchronization does not depend on the value of the 
concavity. In fig.§ we report the distributions of Ts for a = 1.05. It can be 
seen that typically synchronization occurs in a few free periods. Furthermore 
Ts increases only slightly with the population size as a power law with a 
small exponent: Ts oc N°'09±o.oi f^^. ^ 2OO to 2000 and a = 0.5. Large 
populations synchronize therefore quite fast as in the linear case. 

From what precedes we would expect that synchronization is impossible 
for large concavities. Without entering into details we shall now see that 
assuming a natural uniform initial distribution of the oscillators phases (and 
not of the states Ei) there is for large concavities a cross-over in the behavior 
of the system towards easier synchronization. 
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Figure 5: a. "Extremal" model with very large concavity. The state value 
evolution function is Eat up to some phase (j) where it abruptly monotonically 
increases up to the threshold. All the oscillators with initial phase smaller 
than (j) have the same state value. They synchronize at the same phase value 
as soon as they receive any pulse 5. b. For a large concavity a hut with a 
smooth state value evolution function E{t) = fa{t), the oscillator with small 
initial phases have also very close initial states. A pulse 5 brings them at 
almost the same phase. 



Large concavities Let us first illustrate the mechanism at work on an 
extremely simplified model shown on fig.^. where we replace the concave 
function by the union of its tangent segments at both extremities. That is 
the free evolution function of the oscillators is now: 

with a > 1. All the oscillators with initial phases in [0, l/(a — 1)] have the 
same initial state value Ei = due to the special form of the evolution 
function. It is clear from fig.|5|a that all these oscillators get in phase and 
synchronize as soon as the first pulse of the evolution occurs. It is then pos- 
sible to show that the large synchronized group that is thus formed absorbs 
thereafter the oscillators that where initially in [l/(a — 1), 1] and the system 
synchronizes completely. 

For smoother E{t) the same mechanism occurs (see fig.|5|b). For small 
phases (/> — > the slope of the evolution function is small and thus the 
E{(j)) are closer to each other than for larger phases where the slope is 
steeper. If the initial packing of the states subsists until one of the closely 
packed oscillators is at the threshold a large avalanche occurs and thus 
the synchronization of many oscillators. It is not obvious that the states 
remain close to each other. Indeed during the free evolution of the system 
(between firings) the gaps between the phases do not change but the states 
get farther apart from each other due to the concavity. On the opposite, 
during firings the gaps between the states remain constant since all the 
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a 


500 


1000 


2000 


estimate a ^ 1 


1.55 


68± 1.0 


83 ± 0.8 


95 ±0.5 


50 


2. 


93 ±0.5 


99.9 ±0.1 


100 


25 



Table 3: i. Probabilities of complete synchronization with the statistical 
error for "large" concavities a = 1.55 and a = 2 with N = 500,1000,2000 
and an a uniform initial distribution of the phases. The last column right 
shows the probabilities expected as for small concavities. 

states are incremented the same way (whereby the phase gaps get smaller). 
Let the oscillators be numbered by increasing order of their initial phases 
(pi+i > 'pf'^ ■ The evolution of Oi towards the threshold is caused as well 
by free evolution between avalanches as by phase advances due to pulses. 
Before reaching the threshold, an oscillator Oi receives N — i pulses from 
the oscillators with larger initial phases. For small initial phases (i — > 1) 
the oscillators Oi and Oj_i receive many pulses and their evolution towards 
the threshold is for a large part due to the phase advances from pulses. 
Possibly there is sufficient evolution due to pulses so that the state gaps do 
not increase enough due to the free evolution to prevent a large avalanche 
of the initially closely packed oscillators. 

On Table (^) we see that for concavities a = 1.55 and a = 2 synchro- 
nization already occurs with a larger probability that expected with the 
estimate from small concavities. As expected the probability for synchro- 
nization increases with a for a given population size A^. We see also that 
the probability increases with N. This is the consequence that with a uni- 
form distribution of phases the oscillators are at the beginning denser for 
larger populations in the flat section of E((p) and larger synchronized groups 
form at the beginning of the evolution thus enhancing the positive feedback. 
Large concavities favor synchronization only for a uniform distribution of 
the initial phases. Indeed if, instead of the phases, the states Ei of the 
oscillators were initially uniformly distributed in [0, 1], there would be, per 
definition, no clustering and the oscillators would stay apart, as it is easy 
to verify looking at fig.^. An initial uniform distribution of the phases is 
however a natural assumption for the beginning of the evolution. 

Finally, the main conclusion of this section is that surprisingly the form 
of the oscillator state variation function E((f)) is not actually relevant for 
synchronization that occurs with high probability for functions E((f)) which 
are convex, linear and even concave provided the phases are randomly dis- 
tributed initially. The usual interpretation of "leakiness" (implying con- 
vexity) as a requirement for synchronization must therefore be revised. Up 
to now we have considered only identical oscillators. In the following sec- 
tions we show that in populations of oscillators with different randomly 
distributed characteristics, synchronization occurs also in a different way 
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that what we have seen up to now. 



3 Systems with quenched disorder 

We shall see that with quenched disorder, synchronization is the combined 
consequence of several causes. For the sake of simplicity we show how syn- 
chronization occurs in the cases of oscillators with respectively different free 
frequencies then different amplitudes and finally of oscillators with different 
frequencies and amplitudes. The mechanisms at work are the same for the 
different kinds of disorder although some important peculiarities depend on 
the models. In brief, these mechanisms and the main steps of the demon- 
strations are the following. 

We write the first return map for the phase of a given oscillator Oj 
on a cycle beginning and finishing when another given oscillator Oj is at 
the threshold. During such a cycle all the oscillators of the system fire 
once. The first return map shows that due to the quenched disorder Oj 
and Oj inevitably fire at some time, after some cycles, in a same avalanche 
independently of the initial values of their states. After their relaxation, 
oscillators that have fired together are at the origin and in phase such that 
Ei = Ej = (assuming a refractory time). However, contrary to the case of 
identical oscillators, the fact that they have simultaneously relaxed together 
does not imply that they will forever continue to fire together. Indeed dif- 
ferent intrinsic rhythms or different responses to pulses (see later) dephase 
the oscillators that were in phase. However, it is physically clear that for 
oscillators with sufficiently close characteristics (frequency, threshold, shape 
etc. . . ), the disorder cannot destabilize a group of oscillators that have fired 
once together. More precisely, it is possible to state stability conditions that 
have to be fulfilled by any group of oscillators that have fired together in 
order to remain synchronized. Since any two oscillators necessarily fire at 
some time simultaneously, all the possible groups fulfilling stability condi- 
tions are formed during the evolution. If the stability conditions are fulfilled 
by the whole oscillator population larger, groups progressively form up to 
complete synchronization independently of the initial values of the Ei. The 
probability for complete synchronization is therefore the probability that a 
random sample of oscillators fulfills the stability conditions on the whole 
system. 

3.1 Distribution of frequencies 

In this section we consider models of linear IF oscillators with a spread of 
intrinsic frequencies. Since we shall not allow adaptation]^ of the free fre- 
quencies, two oscillators that fire once simultaneously do not subsequently 

*By adaptation of the frequencies we mean as in a "learning" mechanism, where 
the osciUators are aUowed to modify their intrinsic frequencies in order to match with an 
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a. 






b. 







c. 


Ai 


(t)f + 5 + Ai 


d. 


- - ^ 




e. 





f. 


(/.^-(/^f +A2 

0f 


A2 


g- 





Table 4: a. Oscillator Oi is at the threshold; h. Firing of Oi assuming that 
Oj is not pushed above the threshold; c. Effect of the sum Ai of all the 
pulses from other oscillators of the system between the firings of Oi and the 
one of Oj; d. Oj at the threshold; e. Firing of Oj; f. Effect of the sum A2 
of the pulses between the Brings of Oj and Oi back at the threshold; g. Oi 
back at the threshold. 



reach the threshold at the same time and in general do not fire simultane- 
ously again. For a system with a spread of the intrinsic frequencies we shall 
therefore consider synchronization of oscillators as relaxation in the same 
avalanche, which corresponds to temporal synchronization in the limit of 
very short characteristic time for the transmission of the pulses compared 
to the period of free evolution (see also |2.1| ). Let in our model all the os- 
cillators be identical apart from their free periods 0f which are uniformly 
randomly distributed in an interval [(pmim 't'rnax]- Without loss of general- 
ity we take their common slope equal to one so that each oscillator has a 
threshold Ef = The pulse strengths of all the oscillators are supposed 
to be identical and equal to (5 = aa/N with a = {(pmin + the center 

of the distribution interval of the periods. 

We follow the steps of the demonstration of synchronization outlined 
before. From Table ^ we see that the first return map of the phase of Oj on 
a cycle is 

Since the periods are random parameters, — (pj) is typically a non 
zero constant. If this difference is positive Oj comes closer to its threshold 
Ej at each cycle beginning with Oj at Ef . Therefore after some cycles the 
firing of Oj drags Oj along in an avalanche. If (c/i^ — (p'[) < we are in the 
previous situation by interchanging Oj and Oj. In any case the conclusion 
is the same: at some time the two oscillators fire in a same avalanche. 

Just after their relaxation in the same avalanche, the states and phases 
of Oj and Oj are both at zero. Since the oscillators have the same slopes 



exterior periodic stimulus. 
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Figure 6: Two oscillators Oi and Oj with different periods (j)^ and (pj, {(p^ < 
(j)^) and identical slope. In (1) the two oscillators have just relaxed in an 
avalanche and are in phase at the origin; both oscillators evolve thereafter in 
phase. In (2) the oscillator Oi with the highest frequency is at his threshold 
Ef. Oj is at a distance Ej — Ef below its threshold. 

the pulses from the rest of the system mcrement the phases of Oi and Oj 
with the same value and both oscillators evolve therefore in parallel with 
Ei = Ej until the oscillator with the highest frequency, say Oj, reaches first 
its threshold Ef. When Oj fires, Ej = Ef and is therefore below its threshold 
Ej (fig. ^). Both oscillators remain synchronized only if the pulse from Oj 
is sufficient to push Oj above its threshold, so that the stability condition 
for a pair oscillators is: Ef + 6 > Ej (equivalently since the slope is equal 
to one, (j)'^ + 5 > (pj ) . 

More generally, for larger groups, suppose that n oscillators Oj,« = 
1 . . . A'^ with 4'i_^_i > (pi just fired together in an avalanche so that (fn = 
0,Ei = Vi. The oscillator Oi with the shortest period (threshold) is the 
first to reach again its threshold. It triggers an avalanche involving the n—1 
other oscillators if 

(Pt+i - (t>t < iS ,Vi = 2...n. (8) 

This condition comes from the fact that the i + 1-th oscillator receives in 
the avalanche a total pulse i5. A random configuration of frequencies may 
allow complete synchronization if the inequalities (P) are fulfilled for all the 
oscillators of the system (n = N). The probability Vn for a system with 
a random uniform distribution oi N — 2 periods in [(pmim 'Pmax] to allow 
complete synchronization is the product of the probabilities for each gap 
Si = {(pi^i — 0i) to be smaller than iS. Since Sj+i > Sj we get after a change 
of variables: 

Vn = dsi ds2... dsNe-P''' (9) 

^0 J Si Jsm-1 



20 



Figure 7: Probability for a configuration allowing complete synchronization 
in a system of oscillators with a uniform random distribution of intrinsic 
frequencies. The probability depends only on the ratio D/a where D = 
4>max — fpmin Si^nd o = {4>max + 4'min)/'^ and on the Conservation parameter 
a. From left to right a = 0.2, 0.3, 0.4, 0.5. 

= 1 - e-P^ - pde-^P^ - J2 ^^^-^T iP^e-P^ye-P\ (10) 

j=2 ^■ 

where 6 = (^aaii^mia.) " ig the pulse strength and p = -it — — is the 
uniform density of the intrinsic periods. This probabiHty depends only on 
the ratio D/a of the width D of the distribution {D = (/^max ~ '^min) 
on the center a = ((/>max + °f distribution through p6 = D/a. 

The probability (|l|) is plotted in fig.0 for a = 0.2, 0.3, 0.4, 0.5 and N = 300. 
We see that for a finite width D a large fraction of the initial samples 
of randomly distributed periods allows complete synchronization, typically 
for D/a < 0.1 and a > 0.2 synchronization occurs in more than 95% of 
the cases. Nevertheless, after a flat section at small widths, V decreases 
rapidly with increasing D/a. Therefore, although complete synchronization 
is possible with very high probability for small D/a, the range of disorder on 
the frequencies compatible with this behavior is limited. In the region of high 
synchronization probability we find that V is unaffected by the population 
size when A'^ is large (typically >z 100) since in this limit only the tails of 
the distributions at large D/a actually depends on N. We have studied the 
duration of the transient Ts until synchronization numerically on simulations 
(see fig. ^ inset). Up to = 500 we found that Ts increases linearly with 
N with a small slope. For instance with D = 0.2, a = l,a = 0.5 we have 
Ts ~ 19 + 0.06A^ (fig-P inset). Since the divergence of Ts with is only 
linear, synchronization occurs in a physically reasonable time. 

In the previous model the system synchronizes at the frequency of the 
fastest oscillator. This is a direct consequence of the absorption rule that 
sets at the origin all the oscillators that participate in an avalanche. It is 
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therefore interesting to study the same model but without the absorption 
rule. Let us remind that for identical linear oscillators synchronization, as 
locking in avalanches, was still possible without absorption. For the model 
with a spread of frequencies the first return map (0) is valid also without 
absorption. Let us take two oscillators Oj and Oj with (pj < (/>?. At some 
time Oi drags Oj in an avalanche: Oi fires and relaxes to zero and, without 
absorption, is immediately incremented to Ei = 6 by the following firing 
of Oj. Therefore after the avalanche the oscillator Oi is more advanced in 
phase and the oscillator with the highest frequency Oj does not necessarily 
reach its threshold first, contrary to the case with absorption. 

It is easy to verify that Oj is the first of the two oscillators to reach its 
threshold Ej if (p^ — (f)'j < 6 i.e. Ef — Ej < 6. In this case the firing of Oj 
automatically drags Oj again in an avalanche since we have Ei — Ej = 6 and 
thus Ef -E'^ <5^ E^ - Ej = E^ -Ef + 6<6. The two of oscillators are 
therefore locked in an avalanche and form a stable group that fires with the 
longest period cj)'^ of the two. If — > (5 then Oj is first at its threshold 
and fires before Oj. Although it is possible that Oj and Oj avalanche again 
together this time, the two oscillators can not remain locked in an avalanche 
further. Indeed, Ej — Ei = 6 since Oj fired first and when Oj is back at E'^ 
we have Ef — Ei = Ef — Ej + 5 > 6 so that Oj does not avalanche with Oj . 

We see that without absorption synchronization of two oscillators is still 
possible but at the lowest frequency. This result can be straightforwardly 
generalized to N oscillators following the same procedure as in the case 
with absorption. We find actually that the locking conditions for the whole 
system are a set of inequalities equivalent to (^) so that the probability of 
complete synchronization for a uniform distribution of (pi in [cpminjfpmax] is 
given by the same expression as (|lO|). 

Let us just mention that the fact that synchronization occurs also with- 
out absorption is important for the behavior of some lattice models of os- 
cillators displaying SOC [57, 61]. In these models the oscillators are locally 
coupled by pulses without an absorption rule. As first shown by Middle- 
ton and Tang on the Olami-Feder-Christensen model ||57[| , depending on the 
number of nearest neighbors, oscillators have different effective frequencies. 
From what precedes, we would expect some synchronization in the system 
and indeed, a tendency towards synchronization is observed also on the 
lattice. Complete synchronization does not occur, but there is partial syn- 
chronization at all scales | |61| . 

We see finally that in a simple model of IF oscillators with a spread of the 
free frequencies synchronization can occur in the form of locked avalanches 
with or without the absorption rule, i.e. a refractory time. However the 
presence or not of the absorption rule changes drastically the nature of the 
synchronized avalanches which are respectively triggered by the oscillator 
with highest and shortest free frequency. This sensibility to the absorp- 
tion rule together with a probability of synchronization strongly dependent. 
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Figure 8: Oscillator with different amplitudes Ef and equal frequency. With 
(j)^ = 1 the oscillators have different slopes ai = Ef. A pulse of strength 5 
dephases two oscillators that avalanched together and were in phase at the 
origin. The oscillator Oj with lowest slope gets the largest phase advance 
(S/ttj) and reaches the threshold before Oi. If the state Ei of Oi is at a 
distance to its threshold Ef smaller than the value 6 of the pulse of Oj then 
the two oscillators stay synchronized. 

above some value, on the distribution width indicates that, apart in some 
Umits, in a real situation synchronization is restricted by a disorder on the 
frequencies. 

In a model with pulses with a finite fall time Tsodyks et al. [^] showed 
that synchronization is unstable. However, our results show that synchro- 
nization is not incompatible in principle with a disorder in frequencies in 
pulse coupled oscillators models in the limit of short instantaneous pulses 
and when the notion of synchronization in avalanches is valid. 

3.2 Oscillators with different amplitudes 

In this section we keep the frequencies of the oscillators equal (the period is 
= l,Vi) and let the thresholds have different values (fig.^. Each oscil- 
lator Oi is then characterized by a threshold Ef and has a slope ai = Ef. 
By disorder on the amplitudes we mean therefore disorder on the thresh- 
olds with related distribution of the slopes. We keep the pulse equal for 
all the oscillators: 6 = a/N. Since all the oscillators have the same free 
period, synchronization in the sense of variation in phase of all the oscilla- 
tors and simultaneous relaxations is possible in this model. We follow the 
same steps as previously. Since the mechanisms at work are similar than 
in the model with a distribution of frequencies we leave the details of the 
discussion in appendix (|^). Since the frequencies are now equal and the 
slopes and thresholds are different, the main differences with the preceding 
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section are in the reasons why simultaneous firings occurs and groups form. 
Here also the phase gap between any two oscillators changes monotonically 
after each cycle, so that any two oscillators avalanche at some time together. 
The change in the phase gaps between the oscillators that finally cause the 
simultaneous firings has for origin also here the different rhythms of firings 
of the oscillators. But contrary to the previous model where the different 
rhythms were intrinsic, now the different rhythms of firings of the oscillators 
are only effective and caused by the different responses of the oscillators to 
pulses. Indeed a given pulse causes a larger phase advance on an oscillator 
with a smaller slope. Under the effect of pulses oscillators with small slopes 
have larger effective rhythms than oscillators with large slopes. 

Oscillators with close threshold values that avalanched together can re- 
main locked in an avalanche and form a stable group. The stability con- 
ditions for the whole system of N oscillators are similar to (^) and lead 
to the following probability Vj^ of complete synchronization for a uniform 
distribution of slopes in [a — ^ , a + 



Vn = /0^"M dsi ds2... dsN-2e-P'''-^ (11) 



Jsi "'sjv-3 

= 1 - e-P^' - paie-^P"' - V ^^-—^ {paie-P^'Y e-P^\ (12) 

j=2 

with p = ^ and ai = Omm = ~ Vn depends on through pai = 
N{-^ — ^) and is independent of the dissipation parameter a. Pn goes to 
1 with increasing N and for a finite population size the model does not 
synchronize only for very large disorder, typically D ~ 2a. 

In short, we see that as in the model with a distribution of frequencies, we 
found that the duration of the transient Tg until synchronization increases 
linearly with N (fig. ^). For identical a and D/a, is shorter in the case 
with disorder on the amplitudes than on the frequencies (fig. ^ inset). T5 
depends strongly on the dissipation a. However we do not have enough data 
for a precise relationship. 

As in the model with a distribution of frequencies, complete synchroniza- 
tion occurs independently of the initial values of the phases (states) if the 
locking conditions of all the oscillators in a single group are fulfilled. The 
conditions for this locking depend however on the models. Starting the evo- 
lution of the system from random phases, the formation of the possible stable 
groups comes from the evolution of the relative phase gaps between the os- 
cillators due to different rhythms which have their origin in the quenched 
disorder on the characteristics of the oscillators. In the model with different 
slopes they come from the different phase advance responses to pulses of the 
oscillators. 
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Figure 9: Mean durations Ts until synchronization for the model with 
a distribution of amplitudes of width I = 0.5 around the unit for a = 
0.5, 0.6, O.Sftop to bottom) as a function of the population size N. Inset: 
mean durations to synchronization for the models with a distribution of am- 
plitudes (bottom) and of frequencies (top) for a distribution width D = 0.2 
and a = 0.5. For the frequencies T5 ~ 19 + 0.06A^ 

For a given level of disorder and same a the probability of synchroniza- 
tion is much higher in the case of a disorder on the amplitudes (thresholds) 
than on the frequencies with also shorter T5 (fig]9| inset). In short, disorder 
on the amplitudes and slopes is not a strong restriction of synchronization 
which is much more limited by the disorder on the frequencies. It is however 
not possible to conclude directly on what happens when both disorder exist 
simultaneously and we shall now therefore study this case. 

3.3 Disorder on the frequencies and amplitudes 

The mechanism of synchronization that we saw at work in systems with two 
different kinds of disorder is still at work and leads also to synchronization in 
a system with mixed disorder as well on the frequencies as on the thresholds. 
For two oscillators Oi and Oj as previously, the first return map for the phase 
of Oj is now 

0j+i = 0,^ + A,,, (13) 

with 

A,, = {<P'j - + (14) 
aittj 

The phase variation Aij is due now as well to the difference of the free 
frequencies (first term of (|l4|)) as to the different response of oscillators of 
different slopes to pulses (second term of ([T^)). Since there is no relation 
between the signs of {(pj — cp'i) and of (aj — Oj) the two terms may be opposite. 
But generically they do not cancel each other since the periods and slopes are 
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1 (p;= (p^ 



Figure 10: Oscillators with a spread of periods and thresholds ((/)-^,Oj) S 
[1 — 1/2,1 + 1/2]'^. Two oscillators Oi and Oj with < cj)'^ and ai > aj have 
different locking conditions according to the strength of the dephasing pulse 
A. The locking condition depends on the order of the firings which depends 
on A. For a small A, Oi is at the threshold before Oj. For a large A (case 
represented in the figure), the oscillator Oj which has the largest period is 
Erst at the threshold. 



random. The phase gap between Oi and Oj varies therefore monotonically 
and both oscillators avalanche at some time together. 

Here also there are locking conditions of oscillators in avalanches so that 
stable groups form and may grow up to complete synchronization. However 
it is not possible in this case to get the probability of complete synchroniza- 
tion proceeding as previously by simply establishing the locking conditions 
for all the N oscillators in an avalanche. These conditions are necessary but 
not sufficient anymore to ensure synchronization for any initial distribution 
of the oscillator states. Indeed it is possible to verify that for large disorder 
there are cases were the formation of a stable group between two oscillators 
Oi and Oj with Oj > Uj actually depends on the configuration of the phase 
values in the system and of its history (fig.[lO|). We studied the probability 
of synchronization numerically on simulations with random thresholds and 
periods uniformly distributed in [1 - D/2,1 + D/2] * [1 - D/2,1 + D/2]. 
We see on fig.|ll| for N = 300,400,500 and a = 0.5 that up to L» ~ 0.1 
complete synchronization occurs in more than 99% of the cases and that 
the probability is still high for larger widths. In the cases without complete 
synchronization the asymptotic behavior consists in the periodic avalanches 
of a large stable group with some few small ones. For small disorder the 
probability of synchronization depends only weakly on A^: for a given D the 
probabilities found for = 300, 400, 500 are all within the statistical errors. 



As seen on fig. 12 the duration of the transient occurs in only a few 



periods although it increases polynomially with the disorder width. While 
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Figure 11: Probahility of synchronization for a system of N oscillators with 
a uniform spread of periods and thresholds {(p^, Oj) G [1 — 1/2, 1 + //2]^, with 
N = 300, 400 as a function of the width I for a = 0.5. Each point is the 
probability obtained with 1000 samples of random oscillator parameter and 
is represented with the statistical error. 

the duration increases also with the population size N, we do not have 
enough data to establish a precise relation. 

At this point it is not difficult to imagine other models that synchronize 
following the same principles. A model with a distribution of frequencies 
and slopes and with constant threshold as been presented in [^]. We can 
also consider disorder on the pulse strengths. Let us, for instance, take a 
population of identical oscillators with a quenched disorder only on the pulse 
strengths so that the firing on an oscillators Oj transmits to the rest of the 
system a pulse of strength Ui/N . The phase gap between two oscillators 
Oi and Oj varies then as Sj.j = (a^ — aj)/N. Since generically the Sij / 
any two oscillators participate at some time in the same avalanche and since 
the slopes and thresholds are identical the two oscillators are automatically 
locked. 

We see finally that with instantaneous pulses, models with quenched 
disorder on several oscillator characteristics may also evolve to synchroniza- 
tion by the same mechanism of evolution of the gaps and locking in stable 
groups. The analysis and the estimation of the probability of synchroniza- 
tion is however more complicated. 

4 Conclusion 

In this article we have highlighted on some simple models the existence of 
several mechanisms leading to synchronization of IF oscillators. A surpris- 
ing result is that contrary to a common belief, synchronization can actually 
occur even in basic models and for identical oscillators independently of 
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1.25 



Distribution width 



Figure 12: Mean duration T5 until synchronization for the models with 
disorder on the frequencies and on the thresholds ((/>f , Oj) G [1 — 1/2,1 + 1/2]'^ 
as a function of the distribution width for N = 500, 400, 300 and a = 0.5. 
Ts grows polynomially with D, for N = 500, Ts ~ 4.5 + 63D + 316D^ with 
correlation coefficient 0.99992. 

the shape of the oscillators. In particular oscihators do not need to have a 
convex evolution function in order to synchronize^. Therefore the common 
interpretation that "leakiness" in the evolution of the free oscillators, which 
implies convexity, is necessary for synchronization should be revised. We 
conclude that the observation of synchronization in a system of IF oscilla- 
tors implies by itself nothing about the shape of the oscillator internal state 
variation function E{(f>). Actually, for very concave oscillators synchroniza- 
tion occurs very easily for the natural choice of initial random phases. It is 
the opposite for a random initial distribution of the states. Therefore the 
nature of the random configuration at the beginning of the evolution has 
possibly important consequences. It would be interesting to study if the 
nature of the random initial configuration has similar consequences also in 
more sophisticated models. 

In this article we assumed direct additivity of the pulses, which is proba- 
bly an excessive requirement for realistic applications. The positive feedback 
effect between groups of different sizes, which is the only mechanism of syn- 
chronization for linear oscillators, occurs also for a softer form of additivity 
where the pulse from one group is not directly proportional to the number 
of oscillators in the group but merely an increasing function of it. Softer 
additivty would however increment the duration of the transient towards 
synchronization and reduce the range of favorable parameters in the case 

S ync hronization with a general shape E{(j)) has been also recently proven by Corral 
et aI|B8| in the case of oscillators with adequate response function to pulses. A response 
function chosen so that the phase advance caused by a pulse gets larger towards the 
threshold is equivalent to a convex E{(j)). 
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with disorder. 

Concerning additivity we see that it is nevertheless true that convexity 
favors synchronization, since it is the only case which synchronizes also with- 
out additivity. However without additivity, i.e. without positive feedback, 
the duration of the transient diverges then at least as (1 — o)~^ in the linear 
. Therefore without additivity a large convexity is necessary 
to keep the durations of the transitory not too long. 

Let us mention that as shown recently by Tsodyks et al. [pO|] , Hansel et 
aj. ||4^ and Abbott and van Vreeswijk ||4l| smooth pulses with finite rise and 
fall time can crucially affect the behavior and destabilize synchronization. In 
this article we assume fast interactions and absorption: when two oscillators 
fire one after the other, the pulse of the second one occurs entirely during the 
refractory time of the first so that the oscillators synchronize in phase. The 
existence of a refractory time and absorption (i.e. assumption of fast pulses) 
is however not necessary for synchronization for identical convex and linear 
oscillators, in which case synchronization occurs also without absorption as 
locking of the oscillators in stable avalanches, in other words this corresponds 
to out-of-phase locking of the oscillators. 

For identical linear and concave oscillators the probability of synchro- 
nization depends entirely on the initial configuration of the phases/states of 
the system. Indeed, some sets of initial configurations do not synchronize, 
for instance when the initial phases are equally spaced so that no group 
can be formed or in cases where the evolution leads to configurations with 
groups of the same size. For linear and highly concave E{(j)) the measure 
of the unfavorable initial configuration is vanishingly small. It is larger and 
limits the probability of complete synchronization for "moderate" concav- 
ity. The degeneracy of the non favorable configuration disappears if some 
disorder is included in the models such as a small spread on the frequencies, 
thresholds or pulse strengths. 

With fast pulse we found indeed that synchronization is possible also 
with a range of disorder on the oscillator characteristics. We find that the 
most difficult situation for synchronization is when the oscillators have dif- 
ferent frequencies, where, for small disorder, a system with a given random 
sample of frequencies synchronizes almost always but, for larger disorder, 
the probability of synchronization decreases rapidly. Synchronization oc- 
curs then in the form of locking in avalanches and should be affected by 
softer additivity. On the other hand, disorder on the shape of the oscilla- 
tors - occurring here through disorder on the thresholds and hence differ- 
ent slopes- with otherwise identical frequencies does not constraint severely 
synchronization. When both kinds of disorder are mixed the probability of 
complete synchronization is limited by the spread on the frequencies. 

A point of interest would be to investigate how the discussed effects 
occur in more complex realistic models for instance of biological relevance. 
In particlar it would be important to study the robustness of the results 



limit a —5- 1 [36 
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Gi at threshold 
Relaxation of d 



Gj at threshold 



Relaxation of Gj (^1 



Gi at threshold 



1 





+ N,5] " 



1-1 



Table 5: Evolution of the phases of two isolated groups Gi and Gj of Ni and 
Nj oscillators {Ni > Nj) on a cycle where the firing of the first group does 
not succeed to drag the second one along in an avalanche {{(pj)"" + < 
Ec = l). 



when the interaction pulses have finite rise and fall times and for systems 
that are not globally coupled. 
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A APPENDIX A: PROOF OF SYNCHRONIZA- 
TION FOR SMALL CONCAVITY 

In this appendix we prove the synchronization of an assembly of N identical 
oscillators with state evolution function E(t) = t°',t & [0,1], a > 1 in the 
limit a ^ 1. Let us first study the synchronization of only two isolated 
groups Gi and Gj of respectively Ni and Nj oscillators with {Ni > Nj) in 
absence of any other exterior pulses. In table ||, we trace the variation of 
the phases and state variables of the two groups on a cycle of relaxations 
beginning with the largest group at the threshold. We deduce from there 
that the first return map for the phase of the second group Gj is 



p^r + Ni6 



+ Nj6)\ (15) 



which has an attractive fixed point (pQ{a, Ni, Nj,6). If the new phase after 
a cycle 4>'j~^^ is in the interval Ic = [(pc{cL,Ni,6),l] where (pc{a,Ni,S) = 
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Figure 13: Test for the synchronization of two groups for concave oscillators. 
a. The Bring of Gi causes the avalanche of the second group G2 if E2+Ni5 > 
1, that is if (f)"^^^^ ^ (f^c- 4'o Is the fixed point of the first return map for 
the phase of G2 on each cycle beginning with Gi at the threshold, b.) If 
^f^^^^ < (pc the second groups never comes sufRciently close to the first one 
in order to avalanche together. d in the hgure), the oscillator Oj which has 
the largest period is first at the threshold. 



(1 — Ni5)a then Gj is absorbed in the relaxation of Gi (see fig. 13). 

(pc corresponds to the phase at which Gj is just pushed at the threshold 
by the pulse of Gi. If (po > (pc, then the gap between the two groups gets 
smaller on each repeated cycle until it becomes sufRciently small for the 
groups to avalanche together and to merge. On the other hand if (po < pc 
the two groups never avalanche together and remain apart. It is analytically 
difficult to test directly if pQ is in 1^. However, since (^) is monotonic on 
each side of the fixed point, it is more convenient to test if P^^^ is in Ic 
when p^- = p'^, i.e. is just at the border of Ic. With p^- = pc this gives the 
inequality: 

h{Ni, Nj) = p^+^ -pk^i-(i- Ni5)-a - {Nj5)'a > 0, (16) 
where h{Ni,Nj) is the variation of the phase of Oj on a cycle assuming 



pj = pc- Let us examine ( |lq ) for two groups with sizes {N + c)/2 and 
(A^ - c)/2. The function g{c) = h{{N + c)/2, {N - c)/2) is monotonically 
increasing in c so that the attraction between the two groups is stronger when 
the size difference is bigger. For a given and a the condition g{c) > is 
fulfilled when c > c(a, N) with 

"^^^ " ^(1 - In fl - ?U ? m (^))+o ({a - If) . (17) 



2aa V 2' V 2/ 2 V2 , . 

Contrary to the case of linear oscillators, two groups of different sizes - 
not only of equal size - may remain apart and not synchronize: if their size 
difference is too small, i.e. c < c, positive feedback is not efficient enough and 
absorption does not occur. c(a, N) is an increasing function of a, so that for 
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larger concavities less configurations with two groups can synchronize. We 
will see that this determines the probability that a system with random 
initial phases synchronizes. 

Up to now we have considered only two isolated groups. In order to see 
if synchronization can occur when there are more groups, let us choose two 
groups and see if at some time they merge together. With many groups it 
is not possible to write a simple first return function on a cycle for the gap 
between two successive groups since this return map depends sensitively on 
the history of the system during this cycle. However we can simplify the 
question and prove that two groups can merge by focusing on the most severe 
condition. For that, let us isolate the two groups from the rest of the system 
as if they would not be affected by the pulses from the oscillators outside 
of the pair. It is easy to see that if the two groups can synchronize in these 
circumstances, they still synchronize in the real situation with the infiuence 
of exterior pulses. Indeed, the pulses of the rest of the system increment all 
the states in the same way and so they do not change the gap Ei(t) — Ej{t). 
Therefore if Oi and Oj are close enough to avalanche together, they do so 
independently of pulses of other oscillators in the system. We can therefore 
focus our study on the case of an isolated pair of oscillators. Let the sizes 
of the two groups be n and n — c. The groups merge if (^) is fulfilled with 
Ni = n and Nj = n — c. Differently from previously we now study (16) with 
Ni+Nj 7^ N. Since h(n, n—c) is again a monotonically increasing function of 
c, the bigger is c, the stronger is the attraction. Therefore the most stringent 
condition for synchronization is for two groups of minimal size difference. 
Keeping this in mind we should now examine (^) as a function of n, i.e. we 
examine f{n) > with /(n) = /i(n, n — c) when n € [c + 1, {N + c)/2]. The 
function f{n) is monotonically decreasing on the variation interval of n with 
the highest value /(c+ 1) > 0. The smallest value fi^^-^) is equal to g{c). 
This value is the change in phase that we studied previously for a system 
of two groups of sizes ^^^y^ and ^^y^- If the condition g{c) > is fulfilled, 
then / is also positive over the whole interval n G [c + 1, (A^ + c) /2] and any 
pair of groups with size difference c synchronizes. Finally we see that it is 
for the case of only two groups of sizes ^^^^ and that synchronization 
is the most difficult and it is this case that determines the most stringent 
condition for this phenomenon. Therefore, assuming that, as in the case 
of linear oscillators, synchronized pairs spontaneously form during the first 
cycle we find that the probability that the system synchronizes completely 
for random initial phases corresponds to the probability that c < c{a,N). 
Unfortunately this is also difficult to calculate. The system synchronizes 
with highest probability if synchronization is possible even for two groups 
of sizes {N + l)/2 and {N - l)/2, that is ff g{c = 1) > 0. This is the case 
when 

a a\ , ol\ a, ( ol\\~^ ( 1 



a<a.l-- (!--!„ !-- +-!„ - + o . (18) 
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a. 


1 




b. 





c. 


1 #^ + 0- 2)5"''"' ^ 


1 


d. 


1 + (?• 2)5''''''' + ^ ^ 





d. 


1 


^ + (AT - 1)5^ 



Table 6: a. Oi at the threshold; b. Firing of Oi , Oj received a pulse 5 
causing an advance in phase S/aj; c. Oj at the threshold, the term (j — 
^)'^ "a a°' comes from the (j — 2) other pulses since the relaxation of Oi; d. 
Firing of Oj; e. Oi hack at the threshold; {N — j + 1) other pulses from the 
rest of the system occurred since the relaxation of Oi . 

Since a > 1 there is an interval of concavities with the same conditions 
of synchronization than the linear case. Then synchronization can stop 
only if the two last groups are of the same size. Since a is close to 1, 
the corresponding range of concave functions is quite small. However as 
discussed in synchronization occurs in practice also with high probability 
for much larger concavities. 

B APPENDIX B: DISTRIBUTION OF AMPLI- 
TUDES 

In this appendix we detail the conditions under which synchronization occurs 
in the model of section (|3.2| ) of oscillators with a distribution of amplitudes 
(thresholds). We follow the same steps as for the model with a distribution 
of frequencies (|3.1| ) . From table |6| we get the first return map for the phase 
of Oj on a cycle beginning with Oi at the threshold: 

^(fc+i) ^ ^(fc) + _ 1)5^1^. (19) 
■' ■' ajQi 

Let aj > aj, then on each cycle (j)j is closer to (j)^ = 1. The phase differ- 
ence <j)i — (j)j decreases and after some repetitions of the cycle the firing of 
Oi drags Oj along in an avalanche. Therefore as in section also in this 
model any two oscillators avalanche at some time together. The change 
in the phase gaps between the oscillators that finally cause the simultane- 
ous firings has for origin the different rhythms of firings of the oscillators. 
Contrary to the previous model where the different rhythms were intrinsic, 
now the different rhythms of firings of the oscillators are only effective and 
caused by the different responses of the oscillators to pulses. Indeed the 
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value of the phase advance caused by a pulse of given strength depends on 
the slopes of the oscillators. Due to the quenched disorder on the slopes 
the oscillator evolve more or less rapidly under the phase advance caused 
by pulses and have therefore different effective rhythms of evolution. The 
evolution towards synchronization due to the different rhythms comes in ad- 
dition to the positive feedback attraction between groups of different sizes 
which causes also the evolution of the phase gaps between oscillators. Both 
effects drive the system in the state of maximal synchronization compatible 
with the disorder. 

We establish now the stability conditions of synchronized groups, i.e. 
the conditions of locking in avalanches. Two oscillators Oi and Oj, say with 
aj > Qi that avalanche together and are in phase at the origin (pi = (f)j = 
are dephased by the pulses from other oscillators, the oscillator Oi with the 
smallest slope being the most advanced. Let A be the summed strength of 
the pulses of the other oscillators between the last simultaneous avalanche 
of Oi and Oj and the return of Oi back at the threshold. A shifts the two 
oscillators apart by the phase difference r = A(aj — Oj)/(ajaj). If the slopes 
Ui and Qj are close enough then r is sufficiently small for Oj and Oj still to 
relax in the same avalanche triggered by Oj. The locking condition for two 
oscillators that avalanched together is (see fig. |8|): 

, tti — Qj 6 , , 

A^^ ^ < — . (20) 

If Oj and Oj were the only oscillators in their avalanche then A = [N — 2)6 
and ( pO| ) is equivalent to Oj — aj < ai/{N — 2). 

For a group of m > 2 oscillators Oj, i = 1 . . . m with Oj+i > aj the locking 
conditions are: 

{ai-ai)<ai^ — — , i=l...m. (21) 

1\ — m 

These inequalities are obtained considering that 

1. the m oscillators that avalanched together and were at the origin are 
dephased by a total pulse A = {N — m)6 before the oscillators Oi is 
back, the first of them, at the threshold. 

2. the i-ih oscillator in the avalanche receives i — 1 pulses from the oscil- 
lators that preceded it. 

Complete synchronization is possible if (|2l| ) is fulfilled for m = N — 1. 
Indeed, if this is the case a stable group with — 1 elements forms. Then, 
this group and the last A^-th oscillator of the system inevitably participate 
in a same avalanche and the whole system becomes in phase without, now, 
any exterior dephasing pulse. 



The relation (|12D in section 3.2 gives the probability for a uniform ran- 



dom distribution of slopes in an interval [a - f , o + f ] of fulfilling 
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